4 research outputs found
Recommended from our members
Bayesian opponent modeling in adversarial game environments.
This thesis investigates the use of Bayesian analysis upon an opponent¿s behaviour in order to determine the desired goals or strategy used by a given adversary. A terrain analysis approach utilising the A* algorithm is investigated, where a probability distribution between discrete behaviours of an opponent relative to a set of possible goals is generated. The Bayesian analysis of agent behaviour accurately determines the intended goal of an opponent agent, even when the opponent¿s actions are altered randomly. The environment of Poker is introduced and abstracted for ease of analysis. Bayes¿ theorem is used to generate an effective opponent model, categorizing behaviour according to its similarity with known styles of opponent. The accuracy of Bayes¿ rule yields a notable improvement in the performance of an agent once an opponent¿s style is understood. A hybrid of the Bayesian style predictor and a neuroevolutionary approach is shown to lead to effective dynamic play, in comparison to agents that do not use an opponent model. The use of recurrence in evolved networks is also shown to improve the performance and generalizability of an agent in a multiplayer environment. These strategies are then employed in the full-scale environment of Texas Hold¿em, where a betting round-based approach proves useful in determining and counteracting an opponent¿s play. It is shown that the use of opponent models, with the adaptive benefits of neuroevolution aid the performance of an agent, even when the behaviour of an opponent does not necessarily fit within the strict definitions of opponent ¿style¿.Engineering and Physical Sciences Research Council (EPSRC
Comparison of the sensitivity of landscape-fire-succession models to variation in terrain, fuel pattern, climate and weather
The purpose of this study was to compare the sensitivity of modelled area burned to environmental factors across a range of independently-developed landscape-fire-succession models. The sensitivity of area burned to variation in four factors, namely terrain (flat, undulating and mountainous), fuel pattern (finely and coarsely clumped), climate (observed, warmer & wetter, and warmer & drier) and weather (year-to-year variability) was determined for four existing landscape-fire-succession models (EMBYR, FIRESCAPE, LANDSUM and SEM-LAND) and a new model implemented in the LAMOS modelling shell (LAMOS(DS)). Sensitivity was measured as the variance in area burned explained by each of the four factors, and all of the interactions amongst them, in a standard generalised linear modelling analysis. Modelled area burned was most sensitive to climate and variation in weather, with four models sensitive to each of these factors and three models sensitive to their interaction. Models generally exhibited a trend of increasing area burned from observed, through warmer and wetter, to warmer and drier climates with a 23-fold increase in area burned, on average, from the observed to the warmer, drier climate. Area burned was sensitive to terrain for FIRESCAPE and fuel pattern for EMBYR. These results demonstrate that the models are generally more sensitive to variation in climate and weather as compared with terrain complexity and fuel pattern, although the sensitivity to these latter factors in a small number of models demonstrates the importance of representing key processes. The models that represented fire ignition and spread in a relatively complex fashion were more sensitive to changes in all four factors because they explicitly simulate the processes that link these factors to area burned